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Summary 



From a public health perspective, systematic, evi- 
dence-based technology assessments and economic 
evaluations are needed to guide the incorporation of 
genomics into clinical and public health practice. 
However, scientific evidence on the effectiveness 
of predictive genetic tests is difficult to obtain. This 
review first highlights the similarities and differences 
between traditional screening tests and predictive 
genetic testing for complex diseases and goes on 
to describe frameworks for the evaluation of genetic 
testing that have been developed in recent years 
providing some evidence that currently genetic 



tests are not used in an appropriate way. 
Nevertheless, evidence-based recommendations 
are already available for some genomic applications 
that can reduce morbidity and mortality and many 
more are expected to emerge over the next decade. 
The time is now ripe for the introduction of a range 
of genetic tests into healthcare practice, but this will 
require the development of specific health policies, 
proper public health evaluations, organizational 
changes within the healthcare systems, capacity 
building among the healthcare workforce and the 
education of the public. 



Introduction 

The decade following the completion of the human 
genome project in 2003 has been marked by diver- 
gent claims about the utility of genomics for improv- 
ing the health of populations. Some people contend 
that interventions based on environmental changes 
will be more effective than those focused on indi- 
vidual behavior change. In contrast, others argue 
that increasing knowledge of genomics and molecu- 
lar pathology could unlock effective diagnostic 
techniques and treatments and better target public 
health interventions. 1 

Writing in 1999, Francis S. Collins predicted that 
the availability of the human genome sequence 'will 
dramatically accelerate the development of new 



strategies for the diagnosis, prevention, and treat- 
ment of disease, not just for single-gene disorders 
but also for more common complex diseases for 
which genetic differences may contribute to the 
risk of contracting the disease and the response to 
particular therapies'. Accordingly, former directors 
of the National Institute of Health (NIH) stated that 
the NIH was strategically investing in genetic and 
genomic research, 3 but at same time there were 
worries that the expanded use of genetic information 
might further escalate the cost of healthcare. 
Genetic tests can not only be expensive, but may 
also lead to downstream costs that follow from test- 
ing. Such costs include the so-called 'cascade 
effect', defined as a chain of events initiated by an 
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unnecessary test, an unexpected result or patient or 
physician anxiety, which results in further expensive 
tests or treatments that may also cause avoidable 
adverse effects and/or morbidity. 5 

From a public health perspective, systematic, evi- 
dence-based technology assessments and economic 
evaluations are needed to establish the use of gen- 
omics in clinical and public health practice. Walter 
Holland 6 argued that 'caution is essential ... While 
genetic screening can certainly help to evaluate risk 
and may be appropriate in certain high-risk groups if 
nothing can be done to alter the finding, the need 
for, and use of, such information must be very care- 
fully considered. Is it useful to diagnose without 
being able to treat?' Even if the information given 
by genetic tests could sometimes be regarded as 
worthwhile in itself (i.e. to inform reproductive 
choices or to make life-planning decisions), there 
is also the risk that in many situations this informa- 
tion could be harmful. Therefore, predictive testing 
is clearly indicated only if early diagnosis will allow 
an intervention that reduces morbidity and mortal- 
ity. In 1968, Wilson and Jungner 7 developed prin- 
ciples of population screening, identifying a set of 
criteria that should be met in order to initiate a 
screening program that could be applied in the 
case of disorders with a genetic component. 

Traditional screening tests and 
predictive genetic testing for 
complex diseases 

When evaluating a traditional screening test it is 
very important to consider the predictive values of 
the test, particularly the positive predictive value, 
that is, the probability of having the disease given 
a positive test result. This conditional probability 
depends on the sensitivity and specificity of the 
test and is known to increase with the prevalence 
of the disease among the population. It is for this 
reason that screening programs are generally tar- 
geted to high-risk groups, among which the preva- 
lence of disease is reasonably high, so that an 
acceptable positive predictive value of the screening 
test may be achieved. 

Can we treat predictive genetic testing of complex 
diseases similarly? Probably not. Predictive genetic 
tests do not allow early diagnosis of a specific dis- 
ease, but instead, they identify the presence of a 
genotype mutation that increases the risk of 
developing the disease in the future. Therefore, the 
positive predictive value is the probability, given a 
positive test result, of having this mutation and the 
risk of developing the disease in the future depends 



not only on the sensitivity/specificity of the test and 
on the prevalence of the mutation among the popu- 
lation, but also on the lifetime risk of the disease and 
on the 'relative risk', i.e. the increased risk of disease 
given the presence of the genotype mutation. 8 Thus, 
the implementation strategies of screening programs 
at population levels are more complex. To increase 
the clinical positive predictive value, i.e. the prob- 
ability of developing the disease given a positive 
test result, both the baseline risk of disease and the 
relative risk should be 'raised'. Consequently, pre- 
dictive genetic testing should be targeted to high-risk 
groups, i.e. individuals already exposed to known 
risk factors that may interact with the genotype 
mutation and should search simultaneously for the 
various mutations, which, if they are all present, 
multiply the relative risk. 8-10 

Although traditional screening tests and predictive 
genetic tests are different, the criteria that should be 
met for the implementation of a particular test are 
the same in principle, with some modifications. 11 
For example, the domain knowledge of disease 
was extended to include knowledge of the popula- 
tion and knowledge of risk and susceptibility. The 
criterion that a treatment should be available was 
diverted into the notion that interventions that 
have physical, psychological and net social benefits 
should be available. Cost considerations should 
encompass the broader societal and health system 
issues. Overall, much more attention is paid to 
ethical, legal and social issues. 

The public health evaluation of 
predictive genetic testing for 
complex diseases 

Scientific evidence on the effectiveness of predict- 
ive genetic tests is without any doubt difficult to 
obtain. An 'ideal' randomized control trial, able 
to demonstrate the efficacy of a particular genetic 
test in prolonging survival or improving the quality 
of life, is simply impossible to perform, mainly be- 
cause it would need to be carried out over a long 
period of time, during which the genetic test would 
very likely become obsolete. In the absence of 
such trials, an analytical framework is needed to 
collect the appropriate evidence in three main do- 
mains: analytic validity, clinical validity and clin- 
ical utility. The analytic validity of a genetic test 
focuses on the laboratory component and defines 
its ability to accurately measure the genotype of 
interest. The clinical validity refers to the ability 
of a genetic test to predict the associated disorder 
(phenotype). The clinical utility defines the 
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elements that need to be considered when evaluat- 
ing the risks and benefits associated with the intro- 
duction of a genetic test into routine practice. For 
each of these three domains, scientific evidence 
should be obtained through the most appropriate 
epidemiological studies and then translated into 
grades of recommendations in clinical practice 
guidelines. Current systems for grading the strength 
of recommendations are based on consideration of 
study design, study quality, consistency of results of 
different individual studies and directness; the 
strength of recommendations depends on the 
quality of evidence, the net benefit of the interven- 
tion and cost considerations. 12 Using these 
approaches, genetic tests could be introduced 
into public health and clinical practice in a respon- 
sible manner, without being 'penalized' by the fact 
that the scientific evidence relating to their effect- 
iveness is limited. 

Elaborate frameworks for the evaluation of genetic 
testing have been developed in recent years; these 
take into consideration the setting in which a 
genetic test is used (for instance, in a screening pro- 
gram) and combine this with quantitative informa- 
tion about the disorder and the test to be applied. 
ACCE (Analytic validity, Clinical validity, Clinical 
utility and associated Ethical, legal and social impli- 
cations) is an example of such a framework, quan- 
tifying as many criteria is possible (e.g. public health 
burden, quality of a test, etc.) and thereby facilitating 
more detailed and rational assessment of the poten- 
tial benefits of testing or screening. 13 The Centers 
for Diseases Control and Prevention (CDC) initiated 
another project, the Evaluation of Genomic 
Application in Practice and Prevention (EGAPP), in 
order to support the development of a systematic 
process for evaluating genetic tests and other gen- 
omic applications that are in transition from research 
to clinical and public health practice. 14 So far, 
EGAPP has provided evidence reports on several 
genetic tests. Similar approaches have been taken 
in Canada, the UK and Germany. 11 

Given limited healthcare resources, the eco- 
nomic evaluation of genetic tests is strategic to the 
decision-making process and providing information 
about both costs and health consequences of alter- 
native courses of action. In fact, genetic testing is 
currently a major topic of health economics, with 
a number of recently published systematic reviews 
covering full economic evaluations of genetic 
tests. 11 Nevertheless, evidence on the cost-effective- 
ness of most genetic tests is scarce, particularly 
because evidence for the efficacy of the tests them- 
selves, which is a prerequisite for the assessment of 
cost-effectiveness, is still limited. 



Is predictive genetic testing for 
complex diseases being used 
appropriately? 

In an ideal world, the availability of genetic tests 
should be based on professional recommendations 
founded on empirical evidence. After the develop- 
ment and validation of a new genetic test, its context 
should be explored, including an understanding of 
the prevalence of the disease and the respective 
mutation; the accuracy of the genetic test in iden- 
tifying the presence of the mutation; the association 
between the genotype and the clinical phenotype; 
the availability and efficacy of interventions to 
prevent the disease and the costs associated with 
screening, follow-up and preventive treatments. 
Professional recommendations could then be based 
on these analyses, practice guidelines formulated and 
the test made available to clinicians and public 
health professionals. In actuality, the availability of 
genetic tests appears to be driven more by the tests' 
technical feasibility and commercial potential than 
by evidence-based medicine. Genetic tests have 
often proceeded directly from development and 
preliminary validation into practice, with little under- 
standing of the public health, economic and psycho- 
social implications of their use. 15 

There is some evidence that genetic tests are not 
used in an appropriate way. In Italy, for example, 
there are many medical genetics organizations, each 
with geographical differences. Counseling is infre- 
quently performed and there is a high number of 
private (for-profit) organizations. Physicians, who 
in the field of genetic testing, as in other medical 
fields, are the final decision-makers, are not yet 
ready to play an appropriate role in the context of 
predictive genetic testing of cancer, for example. 17 
Public health professionals may have the necessary 
attitudinal background to contribute to the proper 
use of predictive genetic testing for chronic diseases, 
but they need additional training to increase 
their methodological knowledge (C Marzuillo, 
C De Vito, M D'Addario, P Santini, A Boccia, 
P Villari, personal communication). There is a 
clear need for specific post-graduate courses in evi- 
dence-based medicine (EBM) for physicians, not 
least because by improving physicians' knowledge 
of the main instruments of EBM (such as clinical 
trials, meta-analyses, economic evaluations and 
practice guidelines), the professional behavior of 
physicians is likely to become more evidence 
based. 18 ' 19 

The integration of genome-based knowledge in a 
responsible and effective way into public health 
practice requires the development of a specific 
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health policy, as is currently being drawn up in Italy 
by the Ministry of Health in the form of a dedicated 
National Plan for Public Health Genomics (PHG- 
NP). 20 Included among the actions to be taken are 
a systematic health technology assessment of pre- 
dictive genetic tests for complex diseases, the pro- 
motion of genomics education among physicians 
and the general public and the development of 
capacity building among all potential stakeholders 
for the healthcare appropriate provision and man- 
agement of predictive genetic testing. 

Public health genomics: 
looking forward 

Even if the quality and quantity of the available 
scientific evidence on the effectiveness of genetic 
tests are limited, evidence-based recommendations 
are already available for some genomic applications 
that can reduce morbidity and mortality and 
many more are expected to emerge in the next 
decade. 11,21 ' 22 To consider the readiness of gen- 
omic applications for practice, a useful framework 
has been developed that considers a genomic appli- 
cation's analytic validity, clinical validity, clinical 
utility, balance of benefits and harms and the exist- 
ence of an evidence-based recommendation. 23 The 
tiers of the classification system are characterized as 
follows: 

(i) Tier 1 applications, including, for example, genetic 
tests for hereditary breast/ovarian cancer, Lynch 
syndrome and familial hypercholesterolemia have 
demonstrated analytic validity, clinical validity, clin- 
ical utility and there are evidence-based guidelines 
encouraging their use. 

(ii) Tier 2 applications have demonstrated analytic and 
clinical validity, but there is no evidence yet for 
clinical utility. 

(iii) Tier 3 applications have not yet demonstrated 
adequate analytic validity, clinical validity or clinical 
utility and have not demonstrated evidence of harm. 

Organizational changes are needed within health- 
care systems to provide genetic tests at the tier 1 
classification level both effectively and efficiently. 
In theory, predictive genetic testing can be used: 
(i) in population screening programs led by public 
health professionals (genetic tests for patients with 
cancer and 'cascade' genetic tests for relatives; new- 
born screening programs with a battery of tests for 
high penetrance genes with low prevalence among 
the population; cancer screening programs with 
stratification on the grounds of genetic predispos- 
ition) and (ii) in primary care settings for early case 
detection and intervention to effect behavioral 
changes. Today, there is a limited evidence base 



to support both genetic population screening pro- 
grams and personalized individual predictive gen- 
etic tests, but the scenario is likely to change 
significantly in the future. 1,22 Whether in a state- 
funded system (such as in the UK) or in more plur- 
alistic service environments (such as in the USA), an 
important priority is to think strategically about how 
health systems need to be changed to meet the 
needs of genomic science in the context of the 
growing burden of chronic diseases. 

This challenge to model the public health gen- 
omic programs and the primary care services 
should be met while taking into account the add- 
itional priorities of: (i) ensuring an appropriate 
evidence-based translation of genomic applications 
into clinical practice and (ii) delivering adequate 
provider and consumer education. 23 The systematic 
health technology assessment of genetic and gen- 
omic applications can mitigate against 'premature 
translation' of new technologies into practice, 
while at the same time ensuring that such technol- 
ogies are not 'lost in translation'. The training, edu- 
cation and development of capacity in the health 
service workforce is crucial, as is the education of 
the public, not least because of the increasing use of 
direct-to-consumer genetic testing. 24 

The past decade has seen the emergence of 
public health genomics, a multidisciplinary field 
that has established scientific and policy founda- 
tions for the appropriate translation of the new sci- 
ence of genomics into health benefits to individuals 
and populations. 22 The time is now ripe for the 
appropriate introduction of a range of genetic tests 
into healthcare practice, but this will require the 
development of specific health policies, proper 
public health evaluations, organizational changes 
within the healthcare systems, capacity building 
among the healthcare workforce and the education 
of the public. In the next decade, rapidly evolving 
genomic tools, including whole genome sequencing 
and a slew of gene-based products such as gene- 
expression profiles, proteomics, epigenomics and 
metabolomics will become available. Public health 
has already established methods for assessing the 
balance of benefit and harm of genomic applica- 
tions in populations, for implementing validated 
applications throughout the population and for eval- 
uating their impact on healthcare and disease 
prevention. 
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